Granville Ferry (2006 population: 161) is a village in the Canadian province of Nova Scotia, located in Annapolis County .